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CONTEOTS 


I.  Research  During  the  Past  Year 

A.  Networks  for  Selecting  Patterned  Inputs  and  Outputs 

Many  studies  have  concerned  simplified  models  of  neural 
networks.  I  have  studied  additional  properties  of  the 
very  same  models  which  have  often  been  overlooked  in 
trying  to  relate  network  structure  to  behavior.  I  found 
that  many  behavioral  properties  might  be  accounted  for 
if  the  resonant  modes  of  the  networks  constituted  the 
desired  input  or  output  patterns,  and  I  showed  how  in¬ 
finitely  many  networks  of  simple  elements  could  realize 
systems  having  the  desired  patterns. 

(a)  Purpose,  p.2  (b)  Progress,  p.  2  (c)  Publications,  p.  3 

B.  Computer  Model  of  Sensorimotor  Development 

Some  features  of  a  baby's  sensorimotor  development  have 
been  incorporated  into  a  computer  program,  I  have  not 
tried  to  simulate  the  details  of  what  a  baby  does.  I 
am,  rather,  trying  to  learn  what  principles  of  operation 
one  would  look  for  in  any  kind  of  system,  biological  or 
otherwise,  that  can  really  be  said  to  be  perceiving  and 
performing  skilled  actions.  Like  the  work  described  in 
Section  A,  this  study  seeks  new  uses  for  the  same  ele¬ 
ments  which  are  being  employed  by  many  investigators. 

(a)  Purpose,  p.  3  (b)  Progress,  p.  i*  (c)  Publication,  p.  $ 

C.  Mathematical  Theory  of  Sensorimotor  Organization  and 
Perception 

This  study  deals  with  problems  arising  in  the  work  de¬ 
scribed  in  Section  B.  Most  current  rigorous  mathematical 
work  has  concerned  the  circuit  elements  of  sensorimotor 
control  systems.  The  present  study  attempts  to  learn  what 
functional  organizations  must  be  built  out  of  these  elements, 

I  have  found  that  recently  developed  mathematical  concepts 
give  a  way  of  thinking  rigorously  about  these  problems  of 
structure.  This  is  a  necessary  condition  for  solving  any  of 
these  problems. 

(a)  Purpose,  p.  6  (b)  Progress,  p.  6 

II.  Proposed  Plan  of  Research 

A.  Networks,  p.  9  B.  Computer  Model,  p.  10  C.  Mathematical  Theory,  p.  10 
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I.  Summary  of  Research  During  the  Past  Year 
A.  Networks  for  Selecting  Patterned  Inputs  and  Outputs 

(a)  Purpose 

A  great  number  of  studies  have  been  devoted  to  networks  pos¬ 
sessing  a  few  of  the  many  properties  of  neural  networks .  For 
example,  many  studies  have  dealt  with  the  switching  properties  of 
elements  with  all-or-none  response.  Many  other  studies  have  dealt, 
on  the  other  hand,  with  the  transmission  of  continuously  varying 
excitation  produced  by  the  interaction  of  elements  capable  of 
graded  responses.  These,  too,  may  serve  as  switching  networks  by 
the  addition  of  thresholds.  Both  these  aspects  of  networks  have 
been  widely  studied  in  regard  to  their  usefulness  in  tasks  requir¬ 
ing  pattern  recognition  and  learning. 

It  is  common  to  say  that  since  learning  means  connecting 
stimuli  with  behavioral  responses,  one  might  look  for  development 
of  corresponding  physical  connections  between  elements  of  the  net¬ 
work,  for  instance,  changes  in  synaptic  conductivities,  or  connec¬ 
tion  strengths  in  general.  These  c tenges  might  cause  the  network 
always  to  respond  to  a  particular  stimulus  with  the  activation  of  a 
circuit  which  produced  a  particular  response,  rather  than  with  a 
different  circuit  which  produced  a  different  response.  This  is  a 
very  useful  approach,  but  there  may  be  other  approaches  which  are 
sometimes  advantageous. 

Another  approach  has  been  investigated  under  the  contract. 

A  list  of  desirable  behavioral  properties  of  the  system  suggested 
designing  the  networks  so  that  their  resonant  modes  constituted 
the  desired  input  or  output  patterns.  These  behavioral  properties 
followed  directly  from  such  a  model,  while  they  would  require 
special  mechanisms  under  the  approach  described  in  the  preceding 
paragraph.  An  example  of  such  a  property  is  that  the  resonant 
network  could  easily  select  a  pattern  of  activity  of  certain  out¬ 
put  elements,  while  rejecting  a  different  pattern  of  activity  of 
exactly  the  same  elements.  In  fact,  the  resonant  networks  for 
producing  patterned  outputs  need  not  consist  of  separate  circuits 
with  a  selector  mechanism,  but  may  have  a  single  circuit  which  at 
different  times  produces  different  patterns. 

(b)  Progress 

In  order  to  investigate  the  feasibility  of  this  approcah,  the 
general  equations  which  would  have  to  be  satisfied  by  such  a  system 
were  presented,  and  specific  examples  of  a  patterned  output  selector 
were  studied  numerically.  It  was  found  that  infinitely  many  linear 
systems  would  suffice  (references  (1)  and  (2)).  Next,  it  seemed 
useful  to  inquire  whether  such  systems  could  easily  be  realized  by 
simple  circuit  elements.  As  an  example  of  a  useful  circuit  element, 
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the  two-factor  linear  model  neural  element  of  Prof.  N.  Rashevsky 
was  considered  (references  (1)  and  (3)),  and  it  was  demonstrated 
that  infinitely  many  networks  of  these  elements  could  realise  any 
of  the  infinitely  many  resonant  systems .corresponding  to  the  de¬ 
sired  patterns.  Two-factor  networks  were  designed  for  the  specific 
numerical  example.  Finally,  the  question  was  raised  whether  it 
would  be  possible  to  obtain  desired  resonant  modes  in  an  aggregate 
of  networks  by  selecting  and  improving  those  networks  which  ex¬ 
hibited  almost  the  desired  behavior,  and  some  formulas  were  derived 
for  the  modification  of  networks  (unpublished). 

(c)  Publications 

1.  Greene,  P.  H.  "On  the  representation  of  information  by 

neural  net  models,"  In  Self -Organizing  Systems 
1962,  edited  by  M.  G.  Yovits,  G.  T.  Jacobi,  and 
G.  D.  Goldstein,  Washington  D.C.:  Spartan  Books. 

2.  Greene,  P.  H.  "On  looking  for  neural  networks  and  'cell- 

assemblies'  that  underlie  behavior.  I.,  A  mathe¬ 
matical  model."  Bulletin  of  Mathematical  Biophysics, 
2k  (1962):  2ii7-27^ 

3.  Greene,  P.  H.  "On  looking  for  neural  networks  and  'cell- 

assemblies'  that  underlie  behavior.  II.  Neural 
realization  of  the  mathematical  model."  Ibid. , 
395-lfLl. 
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B.  Computer  Model  of  Sensorimotor  Development 
(a)  Purpose 

In  order  to  study  the  structure  and  acquisition  of  perception  and 
motor  skills,  some  features  of  a  baby's  sensorimotor  development  have 
been  incorporated  into  a  program  for  the  Philco  2000  at  System  Develop¬ 
ment  Corporation  in  Santa  Monica.  The  Artificial  Intelligence  Division 
of  the  Research  Directorate  at  SDC  has  kindly  provided  the  services  of 
a  programmer,  Mr.  Tferrence  Ruggles,  and  all  the  machine  time  we  could 
use,  without  charge. 

We  have  not  tried  to  simulate  in  any  realistic  way  the  details  of 
what  a  baby  does,  for  this  is  not  our  purpose.  We  are,  rather,  trying 
to  learn  what  principles  of  operation  one  would  look  for  in  any  kind 
of  system,  biological  or  otherwise,  that  can  really  be  said  to  be  per¬ 
ceiving  and  performing  skilled  actions.  A  baby  is  a  very  good  example 
of  such  a  system,  and  we  are  trying  to  model  the  principles  by  which 
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he  operates,  rather  than  the  precise  appearances  of  the  ways  in 
which  he  applies  them.  For  instance,  the  baby  performs  purpose¬ 
ful  actions,  naturally  described  in  terms  of  their  effects  on 
his  environment,  rather  than  in  terms  of  particular  muscle  move¬ 
ments,  which  might  have  been  any  of  a  number  of  entirely  different 
movements  accomplishing  the  same  purpose.  We  are  trying  to  learn 
more  about  the  sequence  of  development  which  can  bring  about  this 
purposive  regulation  of  movements. 

There  have  been  a  number  of  different  approaches  to  problems 
like  these.  One  is  to  deal  with  elements  at  the  neural  network 
level,  adjusting  connection  strengths  or  thresholds,  while  another 
is  to  write  computer  programs  in  which  symbols  may  designate  com¬ 
plex  behavioral  acts.  We  are  working  somewhere  between  these 
levels.  We  wish  to  identify  the  structures  which  the  networks  are 
intended  to  produce,  in  order  to  give  meaning  to  the  choice  of 
network  processes,  just  as  in  studying  a  painting,  we  desire  know¬ 
ledge  at  the  level  of  perspective,  composition,  and  style  to  give 
meaning  to  the  individual  brush  strokes.  By  working  in  between 
the  two  levels  cited,  we  hope  to  learn  how  the  structures  can  be 
brought  into  existence.  We  are,  in  computer  terminology,  trying 
to  build  a  compiler  for  skilled  actions.  The  intermediate  level 
on  which  we  work  expresses  itself  in  our  choice  to  compile  actions 
neither  in  "machine -languages 11  of  individual  nerve  impulses,  nor 
in  terms  of  elaborate  subroutines,  regarded  as  given,  but  in  the 
behavioral  counterpart  of  intermediate  level  symbolic  languages: 
they  have  operations  like  "MULTIPLY  AND  STORE,"  and  we  have  opera¬ 
tions  like  "TURN  HEAD  BACK  AND  FORTH." 

(b)  Progress 

The  approach  was  based  upon  Jean  Piaget's  interpretation  of 
sensorimotor  development,  outlined  in  the  1961  Annual  Report  under 
this  contract.  Since  we  did  not  feel  that  an  attempt  at  a  realis¬ 
tic  simulation  of  the  details  of  infant  behavior  would  be  instruc¬ 
tive,  we  needed  to  work  with  a  simple  model  which  we  hoped  would 
retain  some  of  the  essential  features  in  skeleton  form.  Such  a 
model  was  suggested  by  the  pattern  recognizer  of  L.  Uhr  and 
C.  Vossler  ("A  pattern  recognition  program  that  generates,  evalu¬ 
ates,  and  adjusts  its  own  operators,"  Proceedings  of  the  1961 
Western  Joint  Computer  Conference).  Their  program  was  given  or 
evolved  a  collection  of  templates  which  it  matched  to  stimulus 
patterns,  and  it  weighted  the  templates  according,  to  their  useful¬ 
ness  in  distinguishing  patterns.  We  considered  Piaget's  infant  to 
be  a  collection  of  half  a  dozen  or  so  Uhr-Vossler  machines,  gener¬ 
alized  in  various  ways.  A  machine  corresponds  to  each  basic  activity 
like  moving  the  head,  sucking,  moving  the  arms,. or  grasping.  The 
Uhr-Vossler  templates  are  numerical  patterns  which  are  fitted  to  a 
stimulus  object.  Our  patterns  are  numerical  configurations  describ¬ 
ing  movements  or  nerve  or  muscle  excitations,  and  are  adjusted  to  fit 
the  environment. 
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So  far,  a  substantial  part  of  the  "head  movement  machine"  has 
been  programmed.  Each  head  movement  consists  of  two  parts,  the 
movement  itself,  which,  in  our  initial  version,  is  simple,  and  the 
conditions  for  triggering  it,  which  are  more  complicated,  involving 
a  number  of  special  contingencies.  Examples  of  our  head  patterns 
are  a  head-drifting-at-random  pattern,  a  head-rapidly-back-and-forth 
pattern,  a  head-turning-in-one -direction  pattern,  and  a  suclcing- 
when-head-is-touched-and-sometimes-otherwise  pattern.  We  hope  that 
a  small  number  of  patterns  will  be  sufficient,  recalling  that  all 
the  instructions  for  a  large  general  purpose  computer  are  frequent¬ 
ly  printed  on  a  small  card. 

Our  components  are  turned  on  and  off  and  interact  through 
changes  in  excitation  levels  governed  by  the  two-factor  equations 
for  central  nervous  activity  developed  by  Professors  N.  Rashevsky 
and  H.  D.  Landahl.  For  example,  the  intensity  of  a  certain  "suck¬ 
ing  level"  changes  according  to  these  equations  as  the  lips  pass 
back  and  forth  past  the  nipple.  When  the  sucking  level  reaches  a 
threshold,  sucking  starts,  but  even  before  this,  increase  of  this 
variable  regulates  the  head  movements,  according  to  similar  equa¬ 
tions,  so  that  the  position  of  the  mouth  narrows  down  quickly  to 
the  nipple. 

We  are  not  interested  in  suckling  as  a  physiological  process. 
Reference  1  below  explains  how  suckling  movements  and  their  later 
extensions  are  prototypes  of  acts  which  prolong  perceptual  activities, 
suppress  disturbing  influences,  focus  attention  on  meaningful  objects, 
and  enable  skilled  movements  involving  spatial  relationships.  Section 
3  below  outlines  an  attempt  to  develop  a  theory  which  will  tell  how 
this  development  might  take  place  in  any  perceiving  and  acting  system. 
It  is  only  through  such  a  theory  that  vie  shall  know  what  additional 
mechanisms  to  put  into  the  computer  program,  because  we  are  studying 
sensorimotor  development,  not  a  gadget  that  does  some  one  thing  well. 
One  interesting  remark  is  that,  contrary  to  the  tacit  assumption  of 
many  investigators,  there  is  no  essential  division  between  sensory 
and  motor  systems  in  our  program.  In  fact,  the  sensory  system  uses 
motor  actions  (or  representations  of  them)  in  order  to  perceive.  Our 
attempt  to  understand  how  this  can  be  done  is  one  illustration  of  our 
endeavor  to  look  for  and  at  new  issues  which  must  be  faced  even  though 
we  are  using  the  same  elements  everyone  uses. 

(c)  Publication 

Greene,  P.  H.  and  T.  Ruggles,  "CHILD  and  SPOCK  (Computer  Having 
Intelligent  Learning  and  Development j  Simulated  Proce¬ 
dure  for  Obtaining  Common  Knowledge)",  invited  paper, 
Bionics  Symposium  1963,  Dayton,  Ohio,  March,  1963. 
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C .  Mathematical  Theory  of  Sensorimotor  Organization  and  Perception 

(a)  Purpose 

This  project  is  aimed  at  precisely  formulating  ways  of  describing 
elements  of  sensorimotor  structure  at  the  behavioral,  level  of  actions, 
as  distinguished  from  physiological  processes  or  individual  movements 
which  must  be  organized  into  these  actions.  It  deals  with  questions 
which  arose  in  designing  the  computer  model  of  development  based  upon 
Piaget's  interpretations.  Others  have  looked  at  these  questions  from 
many  different  points  of  view,  but  in  all  these  approaches,  the 
mathematically  describable  elements  are  far  removed  from  the  struc¬ 
tural  organization  at  the  behavioral  level.  Such  studies  either  tell 
about  sub-behavioral  events  (e.g.,  path  weightings,  or  synaptic 
changes),  in  which  case  one  can  only  assert  his  faith  that  the  be¬ 
havioral  items  are  somehow  recoverable,  given  enough  of  the  sub- 
behavioral  events;  or  else  they  tell  how  often  or  how  strongly 
behavioral  items  occur,  but  not  what  they  are.  Is  there  anything 
equally  precise  which  can  be  said  about  the  behavioral  structures 
themselves,  the  acts  as  a  whole?  Recent  progress  indicates  that 
the  answer  is  yes:  it  is  possible  to  formulate  the  questions  mathe¬ 
matically  in  such  a  way  as  to  reveal  the  existence  of  issues  which 
could  not  even  be  perceived  as  issues  previously. 

The  need  for  such  a  formulation  is  generally  being  overlooked 
in  the  torrent  of  papers  appearing  on  the  subjects  of  self -organi¬ 
zation  and  artificial  intelligence.  I  repeat  that  if  one  is 
describing  the  elements  of  composition,  perspective,  and  style  in 
a  painting,  descriptions  of  juxtapositions  of  individual  dots  of 
paint  become  meaningful  only  insofar  as  they  can  be  stated  in  terms 
of  concepts  at  the  compositional  level.  Similarly,  in  understanding 
skilful  human  or  machine  behavior,  the  rules  for  connection  strengths 
and  the  like  between  individual  elements  have  meaning  only  in  rela¬ 
tion  to  the  behavioral  structures  which  are  to  be  achieved.  All 
current  research  efforts  on  logical  networks,  synaptic  strengths, 
and  so  on,  are,  like  any  form  of  circuit  theory,  indispensable  tools 
when  you  want  to  build  something  -  but  first  you  must  know  what  you 
want  to  build. 

(b)  Progress 

The  first  half  of  the  present  contractual  year  was  devoted  to 
identifying  the  behavioral  structures  which  should  be  studied,  and 
looking  for  conceptual  tools  with  which  to  do  so.  The  problems  just 
did  not  seem  to  be  the  kind  mirrored  by  the  problems  of  logic,  in¬ 
formation  theory,  reinforcement  theory,  and  other  common  approaches. 
(Of  course,  these  disciplines  would  be  most  valuable  in  studying 
other  aspects  of  the  same  systems  I  am  studying.)  It  turned  out  that 
certain  concepts  of  "fiber  spaces"  with  "structure  sheaves"  provided 
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the  first  relevant  mathematics  I  had  ever  seen.  These  will  not  be 
explained  here,  but  certain  qualitative  ideas  will  be  presented. 

As  explained  in  the  previous  section,  the  system  is  considered 
to  be  in  part  a  collection  of  devices  which  when  activated  run  through 
their  repertoires  of  acts,  which  have  to  be  modified  and  coordinated 
through  learning.  The  system  is  supposed  able  to  remember  a  few  rela¬ 
tively  undifferentiated  movements  which  work  well  in  some  particular 
circumstance,;  and  not  so  badly  within  a  range  of  related  circumstances. 
The  basic  problem  is  to  piece  together  these  partial  acts,  defined  on 
overlapping  ranges  of  circumstances,  into  an  integrated  act  which 
could  be  performed  in  a  wide  range  of  circumstances,  and  which  might 
utilize  any  of  a  number  of  partial  acts,  all  harmoniously  adjusted. 

This  procedure  must  be  revised  as  more  highly  differentiated  move¬ 
ments  and  discriminations  of  ranges  of  circumstances  become  possible. 
These  ideas,  when  interpreted  in  some  simple  cases,  were  found  to 
be  aptly  stated  in  terms  of  ways  to  adjoin  structures  defined  on 
successively  refined  coverings  of  a  manifold.  Along  with  this  notion 
of  a  basic  function  of  the  control  system  came  an  awareness  of  issues 
concerning  organization  which  could  not  have  been  perceived  before. 

They  came  from  the  wide  range  of  mathematical  associations  which 
cluster  about  the  ideas  which  have  just  been  mentioned.  These  mathe¬ 
matical  issues  directly  involve  the  behavioral  level,  rather  than  the 
sub-behavioral,  and  the  structural,  rather  than  the  enumerative,  as¬ 
pects  of  behavior. 

The  trick  is  to  look  directly  at  acts  and  see  mathematical 
structure.  For  example,  the  physiologist  may  look  at  a  mapping 
between  psysiological  parameters  and  the  position  of  the  hand.  But 
at  the  behavioral  level  we  may  be  interested  to  know  about  the  act 
of  picking  up  a  pencil,  and  we  need  to  find  mappings  between  physio¬ 
logical  parameters  and  the  position  of  the  hand  relative  to  the  pencil. 
However,  the  pencil  could  be  in  any  position,  and  we  would  come  up 
with  the  right  muscle  movements.  Hence,  we  do  not  have  just  one  map¬ 
ping,  but  a  bundle  of  related  mappings  defined  over  a  manifold  of 
possible  positions  of  the  pencil  (or  of  possible  physiological  con¬ 
figurations)  .  The  physiologist  is  studying  single  slices  of  this 
bundle,  but  it  is  possible  to  name  specific  elements  of  bundle  struc¬ 
ture  which  can  be  seen  behaviorally  (if  one  knows  the  concepts  which 
tell  what  to  look  for),  but  not  physiologically.  This  is  important 
because  fitting  the  next  act  to  be  performed  with  the  pencil  to  the 
act  of  picking  it  up  establishes  a  mapping  between  bundles  and  not 
just  slices,  and  the  bundle  structure  imposes  conditions  on  these  map¬ 
pings. 

In  general,  then,  the  mathematical  relations  hold  among  structures 
which  cannot  be  ''photographed"  -  in  the  above  example,  between  struc¬ 
tures  involving  a  range  of  things  the  system  could  potentially  do  in  a 
range  of  different  circumstances,  rather  than  between  the  things  one 
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sees  it  do  before  one's  eyes.  The  fact  that  it  takes  practice  to 
grasp  the  mathematical  ideas  well  enough  to  reason  with  them  shows 
how  much  theoretical  preparation  is  necessary  before  one  knows  what 
to  look  at  in  the  laboratory.  Since  the  mathematical  ideas  cannot 
be  explained  here,  a  different  example  will  have  to  illustrate  the 
point  that  the  significant  relations  hold  between  structures  which 
cannot  be  seen.  The  hand  and  arm  can  move  anywhere,  and  the  eye 
can  look  anywhere:  what  more  is  there  to  say  about  behavioral 
structure?  But  look  instead  at  a  typical  behavioral  task:  learning 
coordination  by  moving  the  hand  while  keeping  vision  focussed  upon 
it.  We  may  think  of  the  line  of  sight  as  a  rigid  rod  pivoted  at 
the  eyeball  and  extending  out  into  space.  The  arm  and  hand  become 
part  of  a  linkage  having  in  effect  a  slider  at  the  hand,  which 
slides  along  the  rod.  The  lengths  of  the  links  are  determined  by 
body  dimensions  and  depth  of  focus.  We  have,  in  effect,  the  kine¬ 
matic  equivalent  of  a  five-bar  linkage,  about  which  much  can  be 
said  mathematically,  whereas  all  that  can  be  photographed  is 
freely  moving  bars  which  can  be  in  any  position  whatever. 

Consider  the  kinematic  example  just  mentioned.  The  fact  that 
we  can  hold  a  pencil  in  our  mouth  or  between  our  toes  and  produce 
our  normal  handwriting  the  very  first  time  shows  that  during  de¬ 
velopment  all  sorts  of  correlations  between  different  kinematic 
mechanisms  had  to  be  learned.  Suppose  that  this  was  done,  as  sug¬ 
gested,  by  piecing  together  partial  acts.  Behaviorally,  we  do  not 
care  which  of  these  partial  acts  is  being  used  at  a  particular 
point  of  the  overall  action.  Any  partial  act  that  works  for  the 
purpose  is  as  good  as  any  other,  so  long  as  it  is  arranged  that 
by  the  time  the  system  has  left  the  region  within  which  the  chosen 
act  fits  the  purpose,  the  system  has  switched  to  any  one  of  the 
class  of  partial  acts  which  fit  the  purpose  in  the  new  region.  Thus, 
from  a  behavioral  point  of  view  we  might  sometimes  wish  to  find  re¬ 
lations  holding,  not  between  the  "photographable"  movements,  but 
between  equivalence  classes  in  which  we  consider  two  movements  equi¬ 
valent  if  they  agree  in  effect  on  any  neighborhood,  however  small, 
of  a  point.  These  classes  are  called  germs  of  the  mappings  consti¬ 
tuting  the  movements.  We  are  also  interested  in  similarly  defined 
germs  of  transformations  measuring  the  differences  between  various 
ways  of  fastening  together  the  partial  acts  into  overall  acts. 

As  development  progresses  and  the  regions  become  more  highly 
differentiated,  one  builds  up  more  complicated  and  refined  versions 
of  the  above  structures.  At  this  more  refined  stage,  the  meaningful 
relations  between  two  small  details  of  the  movements  of  two  kinematic 
mechanisms  which  must  be  coordinated  arise  only  insofar  as  they  may 
be  traced  back  to  their  common  less  differentiated  precursors  which 
sketch  the  broad  outlines  of  the  movements.  One  can  show  that  it  is 
too  much  to  expect  a  reasonable  system  to  trace  these  structures  back 
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in  any  unique  way.  However,  it  is  possible  to  show  (by  a  mathema¬ 
tical  argument  in  which  one  considers  functions  from  an  abstract 
topological  structure  which  describes  the  pattern  of  intersections 
of  the  partial  regions,  to  sets  of  the  above-mentioned  germs  of 
mappings)  that  the  result  of  certain  ways  of  tracing  back  to  pre¬ 
cursors  is  well  defined,  no  matter  how  the  system  does  it.  This 
example  shows  that  it  is  possible  to  formulate  issues  to  be  faced 
and  arrive  at  conclusions  which  could  not  have  been  perceived 
without  the  theory. 

In  summary,  it  may  be  said  that  these  ideas  have  been  de¬ 
veloped  to  the  point  that  it  is  clear  that  the  issues  are  involved 
in  sensorimotor  coordination,  but  it  is  not  yet  clear  whether  I 
shall  be  able  to  derive  the  useful  conclusions  that  I  am  sure 
someone  will.  In  fact,  it  is  only  recently  that  I  have  become  able 
to  understand  the  ideas  well  enough  to  hold  them  all  at  once  in  my 
mind  to  reason  about  them.  If  these  issues  are  as  relevant  as  I 
suppose,  then  understanding  them  is  like  knowing  calculus  if  you  want 
to  be  an  electrical  engineer:  with  it  there  is  no  guarantee  that 
you  will  discover  anything,  but  without  it  you  can't  even  get  started 
trying.  In  other  words,  up  to  a  short  time  ago  I  feel  that  I  could 
not  even  think  about  the  problems,  let  alone  try  to  solve  them. 

During  the  coming  year  I  plan  to  try  to  do  something  useful  with  the 
ideas . 


II.  Proposed  Plan  of  Research 

A.  Networks  for  Selecting  Patterned  Inputs  and  Outputs 

I  plan  to  continue  with  the  study  of  how  to  improve  the  behavior 
of  a  network  that  is  doing  almost  the  desired  thing. 

The  infinity  of  networks  with  the  same  resonant  behavior  will 
differ  in  steady-state  response  and  in  response  at  frequencies  other 
than  the  resonant  frequencies.  I  plan  to  investigate  whether  it  is 
possible  for  a  system  to  select  in  a  natural  way  resonant  nets  satis¬ 
fying  some  condition  on  the  steady-state  and  frequency  responses. 

Of  course  this  is  possible  mathematically,  but  I  wonder  whether  it 
can  be  done  in  a  natural,  self -organizing  way. 

I  plan  to  study  the  equations  already  obtained,  and  others  like 
them,  on  an  analogue  computer  which  is  soon  to  be  installed  at  the 
University.  First  of  all,  I  want  to  get  a  general  feel  for  the  solu¬ 
tions,  for  example:  How  precisely  must  the  parameters  be  specified? 
How  sharp  are  the  resonances?  What  do  superpositions  of  patterns 
look  like?  Is  it  really  easy  to  select  useful  patterns  this  way,  or 
does  it  just  look  good  on  paper?  Is  it  possible  to  improve  networks 
in  a  simple  way? 
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B.  Computer  Model  of  Sensorimotor  Development 

I  plan  to  finish  up  the  straightforward  parts  of  what  Piaget  calls 
Stage  I,  the  use  of  reflexes .  One  of  the  main  things  to  add  to  the 
present  "head  machine"  is  vision.  The  spatial  mechanisms  of  vision  and 
prehension  will  require  messy  mathematics  of  kinematics. 

Once  I  have  these  mechanisms,  I  still  will  not  be  satisfied,  for 
the  point  is  to  understand  the  possibility  of  growth  of  abilities,  not 
how  to  do  one  particular  thing.  In  conjunction  with  the  development 
of  the  theoretical  ideas  (section  C),  I  plan  to  study  how  a  control 
system  can  cause  any  of  a  set  of  kinematically  dissimilar  mechanisms 
to  perform  the  "same"  act.  The  first  step  will  be  to  see  what  the 
computer  needs  to  correlate  the  movements  of  two  different  effector 
mechanisms,  subject  to  the  requirement  that  it  never  will  be  allowed 
to  make  computations  or  keep  elaborate  tables  of  data.  My  hunch  is 
that  this  would  not  be  possible  for  something  like  hand  movements 
alone,  but  that  somehow  it  is  made  possible  by  using  a  hierarchical 
structure  involving  the  rudimentary  spatial  relationships  built  up 
through  such  actions  as  suckling,  as  mentioned  above.  I  am  beginning 
to  get  an  idea  what  to  look  for  theoretically  to  understand  this,  and 
that  will  be  the  subject  of  study  referred  to  below. 

C.  Mathematical  Theory  of  Sensorimotor  Organization 

I  plan  to  investigate  the  ways  in  which  partial  acts  are  pieced 
together  into  a ' total  act  by  means  of  the  notions  of  fiber  spaces . 

For  instance,  one  part  of  learning  a  motor  skill  is  to  take  apart 
pieces  of  other  acts  and  put  them  together  again  in  a  different  way 
to  form  a  new  act.  The  study  of  the  ways  in  which  the  pieces  can  be 
"glued”  together  to  form  spaces  locally  isomorphic  to  the  original 
spaces  is  one  of  the  things  most  naturally  done  using  the  techniques 
1  have  mentioned. 

The  immediate  application  of  such  ideas  is  that  they  tell  what 
structure  has  to  be  represented  in  the  computer  program  of  Section  B 
in  order  for  it  to  perform  the  same  acts  with  different  effector 
mechanisms.  At  the  very  least,  these  techniques  give  a  way  of  sys¬ 
tematically  setting  down  the  necessary  elements  of  information.  I 
plan  to  use  this  systematization  in  getting  the  computer  to  correlate 
the  workings  of  two  different  mechanisms,  as  proposed  in  Section  B. 

In  effect,  I  shall  be  getting  the  computer  to  embody  the  abstract 
structures  of  these  fiber  spaces. 


WHKHHHHi- 


DISTRIBUTION  LIST 


Ass't.  Sec.  of  Def.  for  Res.  and  Eng. 
Information  Office  Library  Branch 
Pentagon  Building 
Washington  25,  D.  C.  (2  copies) 

Armed  Serviced  Technical  Information  Agency 

Arlington  Hall  Station 

Arlington  12,  Virginia  (10  copies) 

Chief  of  Naval  Research 
Department  of  the  Navy 
Washington  2$,  D.  C. 

Attn.  Code  U37,  Information  Systems  Branch 

Chief  of  Naval  Operations 
0P-07T-12 
Navy  Department 
Washington  25,  D.  C. 

Director,  Naval  Research  Laboratory 
Technical  Information  Officer 
Code  2000 

Washington  2$,  D.  C.  (6  copies; 

Commanding  Officer 
Office  of  Naval  Research 
Navy  #100,  Fleet  Post  Office 
New -York,  New  York  (10  copies) 

Commanding  Officer,  0  N  R  Branch  Office 

3h6  Broadway 

New  York  13,  H.  Y. 

Commanding  Officer,  0  N  R  Branch  Office 
\\9$  Summer  Street 
Boston  10,  Massachusetts 

Bureau  of  Ships 
Department  of  the  Navy 
Washington  25,  D.  C. 

Attn,  Code  607A  NTDS 

Bureau  of  Naval  Weapons 
Department  of  the  Navy 
Washington  25,  D.  C, 

Attn.  RAAV  Avionics  Division 


Bureau  of  Naval  Weapons 
Department  of  the  Navy 
Washington  25,  D.  C. 

Attn.  RMWC  Missile  Weapons  Control  Div. 

Bureau  of  Naval  Weapons 
Department  of  the  Navy 
Washington  25,  D.  C. 

Attn.  RUDC  ASW  Detection  &  Control  Div. 

Bureau  of  Ships 
Department  of  the  Navy 
Washington  25,  D.  C. 

Attn.  Communications  Branch  Code  686 

Naval  Ordnance  laboratory 
White  Oaks 

Silver  Spring  19,  Maryland 
Attn.  Technical  Library 

David  Taylor  Model  Basin 
Washington  7,  D.  C. 

Attn.  Technical  library 

Naval  Electronics  Laboratory 
San  Diego  $2,  California 
Attn.  Technical  Library 

University  of  Illinois 
Control  Systems  laboratory 
Urbana,  Illinois 
Attn.  D.  Alport 

Air  Force  Cambridge  Research  Laboratories 
Laurence  G.  Kanscom  Field 
Bedford,  Massachusetts 
Attn.  Research  Library,  CRX2-R 

Technical  Information  Officer 

U,S.  Army  Signal  Research  &  Dev.  Lab. 

Fort  Monmouth,  New  Jersey 
Attn.  Data  Equipment  Branch 

National  Security  Agency 
Fort  George  G.  Meade,  Maryland 
Attn.  R-L,  Howard  Campaigns 


.2 


U.  3.  Naval  Weapons  Laboratory 
Dahlgren,  Virginia 

Attn.  Head,  Compution  Div.,  G.H.  Gleissner 

National  Bureau  of  Standards 
Data  Processing  Systems  Division 
Rpom  239,  Bldg.  10 
Attn.  A.  K.  Smilow 
Washington  25,  D.  C. 

Aberdeen  Proving  Ground,  BRL 
Aberdeen  proving  ground,  Maryland 
Attn.  J.  H.  Giese,  Chief  Compution  Lab. 

Commanding  Officer 
0  N  R,  Branch  Office 

A 

86  East  Randolph  Street 
Chicago  1,  Illinois 

Commanding  Officer 
0  N  R  Branch  Office 
1030  E.  Green  Street 
Pasadena,  California 

Commanding  Officer 

Oi  N  R  Branch  Office 

1000  Geary  Street 

San  Francisco  9,  California 

National  Bureau  of  Standards 
Washington  25,  D.  C. 

Attn.  Mr.  R.  D.  Elbourn 

Syracuse  University 
Electrical  Eng.  Dept. 

Syracuse  10,  New  York 
Attn.  Dr.  Stanford  Goldman 

Burroughs  Corporation 
Research  Center 
Paoli,  Pennsylvania 
Attn.  R.  A.  Trace 

Office  of  Naval  Research 
Washington  25,  D.  C. 

Attn.  Code  U55 


Cornell  University 

Cognitive  Systems  Research  Program 

Hollister  Hall 

Ithaca,  New  York 

Attn.  Dr.  Frank  Rosenblatt 

Lockheed  Missiles  and  Space  Company 
3251  Hanover  Street 
Palo  Alto,  California 
Attn.  W.  F.  Main 

Communications  Sciences  Lab. 

University  of  Michigan 
180  Frieze  Building 
Ann  Arbor,  Michigan 
Attn.  Gordon  E.  Peterson 

University  of  Michigan 
Ann  Arbor,  Michigan 
Attn.  Dept,  of  Philosophy 
Prof.  A.  W.  Burks 

Carnegie  Institute  of  Technology 
Department  of  Psychology 
Pittsburgh  13,  Pennsylvania 
Attn.  Prof.  Bert  F.  Green,  Jr. 

Massachusetts  Inst,  of  Technology 
Research  Lab.  for  Electronics 
Cambridge,  Mass. 

Attn.  Dr.  Marvin  Minsky 

Stanford  University 
Stanford,  California 
Attn.  Electronics  Lab. 

Prof.  John  G.  Ianvill 

.Stanford  University 
Stanford,  California 
Attn.  Electronic  Lab. 

Prof.  Gene  Franklin 

University  of  Illinois 
Urbana,  Illinois 

Attn.  Electrical  Engrg.  Dept.  ! 

Prof.  H.  von  Foerster 

University  of  California 
Institute  of  Eng.  Research 
Berkeley  k,  California 

Attn.  Prof.  A.  J.  Thomas ian  , 

I 

I 


•3' 


National  Science  Foundation 

Program  Director  for  Documentation  Research 

Washington  2 £,  D.  C. 

Attn.  Helen  L.  Brownson 

University  of  California  -  L.A. 

Los  Angeles  2k,  California 
Attn.  Dept,  of  Engineering 
Prof.  Gerald  Estrin 

Hebrew  University 
Jerusalem,  Israel 
Attn.  Prof.  Y.  Bar-Billel 

Massachusetts  Insitute  of  Technology 
Research  Laboratory  of  Electronics 
Attn.  Prof.  W.  McCulloch 

University  of  Illinois 
Champaign  Urbana,  Illinois 
Attn.  John  R.  Pasta 

Naval  Research  Laboratory 
Washington  2£,  D.  C. 

Attn.  Security  Systems 
Code  5266,  Mr.  G.  Abraham 

Zator  Company 
II4O  l/2  Mt.  Auburn 
Cambridge  38,  Massachusetts 
Attn,  R.  J.  Solomonoff 

Telecomp utiiig  Corporation 
12038  Saticoy  Street 
North  Hollywood,  California 
Data  Instruments  Division 
Field  Engineering  Dept. 

NASA 

Goddard  Space  Flight  Center 
Washington  2J>,  D,  C. 

Attn.  Arthur  Shapiro 

Cornell  University 
Department  of  Psychology 
Ithaca,  New  York 
Attn.  Prof.  Robert  B.  Maclnod 

Dr.  W.  Ross  Ashby 
University  of  Illinois 
Dept,  of  Electrical  Engineering 
Urbana,  Illinois 


National  Physical  Laboratory 
Teddington,  Middlesex 
England 

Attn.  Dr.  A.  M.  Uttley,  Superintendent 
Autonomies  Division 

Dr.  George  B.  Yntema 
United  Aircraft  Corporation 
Research  Laboratories 
East  Hartford  8,  Connecticut 

Swarthmore  College 
Swarthmore,  Pennsylvania 
Attn.  Department  of  Electrical  Engrg. 
Prof.  Carl  Barus 

Dr.  Jacob  Beck 
Harvard  University 
Memorial  Hall 

Cambridge  38,  Massachusetts 

Diamond  Ordnance  Fuze  Laboratory 
Connecticut  Ave.  &  Van  Ness  St. 
Washington  2 $,  D.  C. 

0RDTL-012,  E.  W.  Channel 

Harvard  University 
Cambridge,  Massachusetts 
Attn.  School  of  Applied  Science 
Dean  Harvey  Brook 

Commanding  Officer  and  Director 
U.  S.  Naval  Training  Device  Center 
Port  Washington 
Long  Island,  New  York 
Attn.  Technical  Library 

Office  of  Naval  Research 
Washington  2f>,  D.  C. 

Attn.  Code  li5>0,  Dr.  R.  Trumbull 

Wright  Air  Development  Division 
Electronic  Technology  Laboratory 
Wright-Pat ters on  AFB,  Ohio 
Attn.  Lt.  Col.  L.M.  Butsch,  Jr. 

ASRUEB 

Laboratory  for  Electronics,  Inc. 

1079  Commonwealth  Ave. 

Boston  15,  Massachusetts 
Attn.  Dr.  H.  Fuller 


Stanford  Research  Institute 
Computer  Laboratory 
Menlo  Park,  California 
Attn.  H.  D.  Crane 

The  Rand  Corp. 

1700  Main  St. 

Santa  Monica,  California 
Attn.  Numerical  Analysis  Dept. 

Willis  H.  Ware 

Zator  Co. 

lljO  l/2  Mt.  Auburn  Street 
Cambridge  38,  Mass. 

Attn.  Calvin  N.  Mooers 

Massachusetts  Institute  of  Technology 
Cambridge  39,  Mass. 

Attn.  Prof.  John  McCarthy,  26-007B 

Office  of  Naval  Research 
Washington  23,  D.  C. 

Attn.  Code  J4.3O 

Carnegie  Institute  of  Technology 
Pittsburgh,  Pennsylvania 
Attn.  Director,  Computation  Center 
Alan  J.  Perlis 

Rome  Air  Development  Center,  RCCR 
DCS/Operations,  USAF 
Griff iss  Air  Force  Base,  New  York 
Attn,  Irving  J.  Gabelman 

Air  Force  Office  of  Scientific  Research 
Directorate  of  Information  Sciences 
Washington  23,  D.  C. 

Attn,  Dr.  Harold  Wooster 

Hunter  College 
New  York  21,  N.  Y. 

Attn.  Dean  Mina  Rees 

Radio  Corporation  of  America 

306/2 

Data  Systems  Division 
8300  Balboa  Blvd. 

Van  Nuys ,  California 
Attn.  Joseph  E.  Karroll 


Mr.  Sidney  Kaplan 
I8II4  Glen  Park  Avenue 
Silver  Spring,  Maryland 

Stanford  Research  Institute 
Menlo  Park,  California 
Attn.  Dr.  Charles  Rosen 
Applied  Physics  laboratory 

University  of  California 
Department  of  Mathematics 
Berkeley,  California 
Attn.  Prof,  H.  J.  Bremermann 

National  Bureau  of  Standards 
Washington  23,  D.  C. 

Attn.  Miss  Ida  Rhodes,  220  Stucco  jBldg 

Northeastern  University 
360  Huntington  Avenue 
Boston,  Massachusetts 
Attn.  Prof.  L.  0.  Dolansky 

Dr.  Stanley  Winkler 
IBM  Corporation 
Federal  Systems  Division 
326  E.  Montgomery  Avenue 
Rockville,  Maryland 

L.  G.  Hanscom  Field/AF-CRL-CRRB/ 
Bedford,  Mass. 

Attn.  Dr.  H.  H.  Zschirnt 

Rome  Air  Development  Center 
Griffiss  Air  Force  Base 
Rome,  New  York 
Attn.  Mr.  Alan  Bamun 

Armour  Research  Foundation 
10  West  35th  Street 
Chicago  16,  Illinois 
Attn.  Mr.  Scott  Cameron 
E.  E.  Research  Dept. 

Department  of' the  Army 
Office  of  the  Chief  of  Research  & 
Development 
Pentagon,  Room  3Dbb2 
Washington  23,  D.  C. 

Attn.  Mr.  L.  H.  Geiger 


Carnegie  Institute  of  Technology 
Systems  and  Communication  Sciences 
Pittsburgh  13,  Pennsylvania 
Attn.  Dr.  Allen  Newell 


Thompson  Rarno  Woolridge  Inc. 
81*33  Fallbrook  Ave. 

Canoga  Park,  California 
Attn.  D.  R.  Swanson 


Cornell  University 

Cognitive  Systems  Research  Program 

Cornell  Computing  Center 

Ithaca,  New  York 

Attn.  Prof.  H.  D.  Block 

Royal  Aircraft  Establishment 
Mathematics  Dept. 

Farnborough,  Hampshire 
England 

Attention  Mr.  R.  A.  Fairthorne 
Minister  of  Aviation 

Harvard  Computation  Lab. 

Harvard  University 
Cambridge,  Massachusetts 
Attn.  Dr.  Anthony  Oettinger 

IBM  Research 

Yorktown  Heights,  New  York 
Attn.  Hans  Peter  Luhn 

Library  of  Congress 
Washington  25,  D.  C. 

Attn.  John  Sherrod 

National  Biomedical  Research  Foundation,  Inc. 
8600  16 th  St.,  Suite  310 
Silver  Spring,  Maryland 
Attn.  Dr.  R.  S.  Ledley 

National  Bureau  of  Standards 
Washington  25,  D.  C. 

Attn.  Mrs.- Ethel  Mar den 

Department  of  Commerce 
U.  S.  Patent  Office 
Washington  25,  0.  C. 

Attn.  Mr.  Herbert  R.  Koller 

Northwestern  University 
Computer  Sciences  Lab. 

The  Technological  Inst. 

Evanston,  Illinois 
Attn.  Dr.  Julius  T.  Tou 


Rand  Corporation 
1?00  Main  Street 
Santa  Monica,  California 
Attn.  Library 

National  Security  Agency 

Deputy  Chief,  Office  of  Central  Ref. 

Fort  Meade,  Maryland 

Attn.  C-3,  Dr.  J.  Albert  Sanford 

University  of  Chicago 
Committee  on  Mathematical  Biology 
Chicago,  Illinois 
Attn.  Prof.  H.  D.  Landahl 

University  of  Pennsylvania 

Moore  School  of  Electrical  Engineering 

200  South  33rd  Street 

Philadelphia  U,  Pennsylvania 

Attn.  Miss  Anna  Louise  Campion 

Department  of  the  Army 

Office  of  the  Asst.  COFD  for  Intelligence 

Room  2B529,  Pentagon 

Washington,  D.  C. 

Attn.  John  F.  Kullgren 

Mr.  Robert  F.  Samson 
Directorate  of  Intelligence  and 
Electronic  Warfare 
Griffiss  Air  Force  Base 
Rome,  New  York 

Army  Research  Office  OCR  &  D 
Department  of  Army 
Washington  2,  D.  C. 

Attn.  Mr.  Gregg  McClurg 

Division  of  Automatial  Data  Processing 
AOP 

Department  of  State 
Washington  25,  D.  C. 

Attn,  F.  P.  Diblasi 
19A16 


-6 


Mr  o  Bernard  M.  Fry,  Deputy  Head 
Office  of  Science  Information  Service 
National  Science  Foundation 
19^1  Constitution  Avenue,  N.W. 
Washington  25,  D»  Co 

International  Business  Machines,  Corp. 
Advanced  Systems  Development  Div. 

San  Jose  lit,  California 
Attn.  I.  A.  Warheit 

Harry  Kesten 
Cornell  University 
Depto  of  Mathematics 
Ithaca,  New  York 

Applied  Physics  Laboratory 
Johns  Hopkins  University 
8621  Georgia  Avenue 
Silver  Spring,  Maryland 
Attn.  Document  Library 

Bureau  of  Supplies  and  Accounts,  Chief 
Navy  Department 
Washington,  D.  C. 

Attn.  Code  W3 

Bendix  Products  Division 
Bendix  Aviation  Corporation 
Southbend  20,  Indiana 
Attn.  E.  H.  Crisler 

Standord  Research  Institute 
Menlo  Park,  California 
Attn.  External  Reports,  G-037 

Officer  in  Charge 

U.  S.  Naval  Photographic  Interpretation 
1*301  Suitland  Road 
Suitland,  Maryland 
Attn.  Mr.  J.  Pickup 

Dr.  Noah  S.  Prywes 
Moore  School  of  Engineering 
University  of  Pennsylvania 
Philadelphia  1*,  Pennsylvania 

National  Security  Agency 
Fort  George  G.  Meade,  Maryland 
Attn.  R.-l*2,  R.  Wiggington 


Federal  Aviation  Agency 

Bureau  of  Research  and  Development 

Washington  25,  D.  C. 

Attn.  RD-375,  Mr.  Harry  Hayman 

Cornell  Aeronautical  Laboratory  Inc. 
P.0.  Box  235 
Buffalo  21,  New  York 
Attn.  Systems  Requirements  Dept. 

A.  E.  Murray 

Institute  for  Space  Studies 
1*75  Riverside  Drive 
New  York  27,  New  York 
Attn.  Mr.  Albert  Arking 

Mr.  Donald  F.  Wilson 
Code  5lUU 

Naval  Research  Laboratory 
Washington  25,  D.  C. 

Navy  Management  Office 
Data  Processing  Systems  Division 
Department  of  the  Navy 
Washington  25,  D.  C. 

Attn.  Mr.  J.  Smith 

Lincoln  Laboratory 

Massachusetts  Institute  of  Technology 
Lexington  73,  Massachusetts 
Attn.  Library 

AFCRL  -  CRRBD  v 
Attn .  H .  Glucksman 
Laurence  G.  Hanscom  Field 
Bedford,  Massachusetts 

Dr.  C.  R.  Porter 
Psychology  Department 
Howard  University 
Washington  1,  D.  C. 

Electronics  Research  Laboratory 
University  of  California 
Berkeley  1*.  California 
Attn.  Director 

Dr.  George  N.  Omstein 
Advanced  Systems  Res.  Group 
NA  Aviation  Co. 

1*300  E.  5th  Avenue 
Columbus,  Ohio 


Mr.  Gordon  Stanley 
7685'  South  Sheridan  Ct 
Littleton,  Colorado 


A.  J.  Cote,  Jr. 

Applied  Physics  Laboratory,  JHU 
The  Johns  Hopkins  University 
8621  Georgia  Avenue 
Silver  Springs,  Maryland 

Institute  for  Defence  Analysis 
Communications  Research  Division 
Von  Neumann  Hall 
Princeton,  New  Jersey 

Dr.  J.  H.  Andreae 
Standard  Telecommunication 
Laboratories  Limited 
London  Road,  Harlow,  Essex 
England 

Allan  Kiron 

Office  of  Research  and  Development 
U.  S.  Department  of  Commerce 
Patent  Office 
Washington  2$s  D.  C. 

Air  Force  Office  of  Scientific  Research 
Information  Research  Div. 

Washington  25,  D.  C. 

Attn.  R.  W.  Swanson 


